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P5 i Abstract 

^ The Quantum Substate Theorem due to Jain, Radhakrishnan, and Sen (2002) gives us a 

powerful operational interpretation of relative entropy, in fact, of the observational divergence 
of two quantum states, a quantity that is related to their relative entropy. Informally, the 
theorem states that if the observational divergence between two quantum states p, a is small, 
then there is a quantum state p' close to p in trace distance, such that p' when scaled down by 
Q^l a small factor becomes a substate of a. We present new proofs of this theorem. The resulting 

statement is optimal up to a constant factor in its dependence on observational divergence. 
I In addition, the proofs are both conceptually simpler and significantly shorter than the earlier 

■ proof. 

1 The Quantum Substate Theorem 

(N 

^ ' Consider quantum states /o, o" G T){T-L), where % \s a. finite dimensional Hilbert space 71, and D(^) 

\^ ■ denotes the set of all quantum states with support in V., i.e., the set of unit trace positive semi- 

i definite operators on T-L. We say that p is a c-substate of cr if p ^ where ^ represents the 

Lowner partial order on operators on Ti. We may equivalently express this condition in terms of 

■ measurement outcomes ("POVM elements") as follows. Let 

O 

P(^) {M G !.{%) ■ 0<M <l} , 

denote the set of POVM elements onT-L, where L(^) is the space of linear operators and I is the iden- 
^ , tity operator on H. The state p is a c-substate of a iff for every measurement outcome M G P(^), 

the probability Ti(Ma) of observing M when a is measured according to the POVM {M, I — M} is 
at least Tr(Mp)/2'^, a 1/2'^ fraction of the probability of observing Af when p is measured. Morally, 
the state a may be decomposed as o" = ap + (1 — a)a, for some a G D(^), with a > 1/2'^. 
This in turn may be used to construct the state p from a through quantum analogues of rejec- 
tion sampling. For example, we may apply the quantum measurement specified by the Kraus 
operators {-v/a p^/^u"^/^, \/l — a a^^'^a~^^'^} , or go through a purification of a [8} [TO]. 
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Given arbitrary quantum states /), o" G D(^) we are interested in how well a masquerades as p 
in the above sense. In other words, we are interested in the least c such that p is a c-substate 
of a. We call this quantity the relative min-entropy Soo(p||o') of the two states. A generalization 
of this notion to bipartite states has been studied by Renner |14l Chapter 3], and the notion itself 
has been studied by Datta [2] as "max-relative entropy". For typical applications, such as privacy 
trade-offs in communication protocols [SI |T0], it suffices to construct an approximation p' to p, 
with respect to a metric on quantum states. This leads us to the notion of the smooth relative 
min-entropy S^(p||cr) of the two states, a quantity implicitly studied by Jain, Radhakrishnan, and 
Sen [HI [To] and later explicitly by Renner [14:\ Chapter 3] and Datta [2] . The metric initially used 
for the smoothness parameter e was the trace distance. The fidelity of quantum states gives us a 
more natural metric in typical applications, and we adopt this measure of closeness in the article. 

Let e G (0, 1) and p,a £ D(^) be such that supp(/j) C supp(c7). We may express the e-smooth 
relative min-entropy S^(p||cr) as the base-2 logarithm of the value of the following optimization 
problem with variables p' G D('W) and k G M: 

minimize: k 
subject to: 

p' :< na 
Trp' = 1 (PI) 
F(p,p') > 1-e 
p G LCH), p' ^ 
K G M, K > 

Here F{p',p) H'v/p'v^lltr' denotes the fidelity between the two quantum states, and =^ 
TrV MtM denotes the trace norm of the linear operator M G L('H). The existence of a pair p', k that 
are feasible for the problem (PI) means that there is a quantum state p' with fidelity f{p',p) > 1 — e 
that is also a (log2 K)-substate of a. The substate constraint implies that k > 1. 

The program (PI) is feasible, as p' '= p and k *= 1/A, where A is the smallest non-zero eigenvalue 
of a, satisfy all the constraints. Therefore we may restrict the optimization to k G [0, 1/A] and the 
compact set of quantum states with fidelity at least 1 — e with p. The e-smooth relative min-entropy 
between the two states is thus always achieved. 

If /9 is a c-substate of a, i.e., their relative min-entropy is at most c, then their relative entropy 
S(/5||o") =^ Tr/9(log2/5 — log2 ct) is also at most c. Jain et al. [8l [10] gave a weak converse to this 
relation via the Quantum Substate Theorem, which gives a bound on the e-smooth relative min- 
entropy in terms of the more familiar notion of relative entropy. This theorem may also be viewed 
as a handy operational interpretation of the rather abstract notion of relative entropy. 

The substate theorem (classical or quantum) lies at the heart of a growing number of applica- 
tions [10[ Section 1]. These include privacy trade-offs in communication protocols for computing 
relations p], message compression leading to direct sum theorems in classical and quantum com- 
munication complexity [9], impossibility results for bit-string commitment [4J, the communication 
complexity of remote state preparation [3], and direct product theorems for classical communica- 
tion complexity [6l[5|. To highlight one of these examples, the Quantum Substate Theorem enables 
(non-oblivious) compression of an ensemble of mixed quantum states to within a constant factor of 
the Holevo information of the ensemble, given access to shared entanglement and classical commu- 
nication, when we are allowed a small loss of fidelity in the compression process. In contrast, the 
compression of arbitrary ensembles of mixed quantum states to the Holevo limit remains an open 
problem in quantum information theory. 
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Jain et al. formulated their bound in terms of a new information theoretic quantity, observa- 
tional divergence D(/9||(t), rather than relative entropy. 

Definition 1 (Observational divergence). Let p,cr ^ D{T-L). Their observational divergence is 

defined as 

D{p\\a) = sup|(TYMp)log2^^ : M G P(7^), TrMa/0 

The supremum in the definition above is achieved if and only if supp(/9) C supp(fT). As is evident, 
this quantity is a scaled measure of the maximum factor by which Tr{Mp) may exceed Ti^Ma) for 
any measurement outcome M of interest. Observational divergence is related to relative entropy. 
In particular, D(p||(t) < S(/9||o") + 1. However, it could be smaller than relative entropy by a factor 
proportional to the dimension \10\ Proposition 4] (see also [7]). 

We present alternative proofs of the Quantum Substate Theorem, also strengthening it in the 
process. 

Theorem 1. Let H be a Hilhert space, and let p,a € D(^) be quantum states such that supp{p) C 
supp(<t). For any e G (0, 1), there is a quantum state p' with fidelity f{p', p) > 1 — £ such that p' ^ 
Ka, where 



1 — e 



Equivalently, for any e G (0, 1), 



SUA") < ^ + iog, 
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The proofs that we present are both shorter and conceptually simpler than the original proof. 
The proof due to Jain et al. consists of a number of technical steps, several of which are bundled into 
a "divergence lifting" theorem that reduces the problem to one in which p is a pure state (a rank one 
quantum state). Finally, the pure state case is translated into a problem in two dimensions which 
is solved by a direct calculation. Divergence lifting involves going from a construction of a suitable 
state p' for a fixed POVM element to one that is independent of the POVM element, by appealing 
to a minimax theorem from Game Theory. We show that this minimax theorem can be applied 
directly to establish the Quantum Substate Theorem. The resulting statement is stronger in its 
dependence on observational divergence. The original bound read as S^(p||(t) < d' /£ — log2(l — e), 

where d' ^= d + 4:\/d + 2 + 2 log2(d + 2) + 6 with d D(/j||cj). The formulation in terms of fidelity 
also allows us to show that the dependence on observational divergence in Theorem [T] is optimal 
up to a constant factor. 

Theorem 2. Let % be a Hilbert space, and let p,a £ 0(7^) be quantum states such that supp{p) C 
supp((t). Suppose k £ is such that for any £ £ (0,1), there is a quantum state p' with fi- 
delity f{p',p) > 1 — e such that p' ^ na, where 



— 2^1' 



or equivalently. 



Then D(p||cr) < 4A: + 3. 



SL(p||a) < -+log2 ^ 



£ °M - e 
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We thus settle two questions posed by Jain et al. [TOl Section 5]. 

For the first proof (Section [2]), we start by converting the convex minimization problem (PI) 
into a min-max problem through a simple duality argument. The minimax theorem now applies 
and reduces the problem of construction of a suitable state p' to one that works for a fixed POVM 
element. The latter task turns out to be similar to proving the Classical Substate Theorem. 
This proof is thus shorter and conceptually simpler than the original one, and also leads to a 
tighter dependence on observational divergence. We present a second proof based on semi-definite 
programming (SDP) duality (Section [3]). We believe that both approaches have their own merits. 
The first approach is more intuitive in that once the problem is formulated as a min-max program, 
the subsequent steps emerge naturally. The second approach has the appeal of relying on the more 
standard SDP duality. These routes to the theorem may prove useful in its burgeoning list of 
applications, as also in the study of smooth relative min-entropy. 

2 A proof based on min-max duality 

In this section, we present an alternative proof of the Quantum Substate Theorem. It hinges on a 
powerful minimax theorem from game theory, which is a consequence of the Kakutani fixed point 
theorem in real analysis \1?>\ Propositions 20.3 and 22.2]. 

Theorem 3. Let Ai,A2 be non-empty, convex and compact subsets o/M" for some positive inte- 
ger n. Let u : yli X — )• M 6e a continuous function such that 

• Va2 G A2, the set {ai G Ai : (Va'^ € Ai) u(ai,a2) > u{a[,a2)} is convex, i.e., for every 02 E 
A2, the set of points ai € Ai such that u{ai,a2) is maximum is a convex set; and 

• Vai G Al, the set {02 G A2 : (Va2 G A2) ^(01,02) < 7/(01,02)} is convex, i.e., for every 
ai G Al, the set of points 02 G A2, such that u{ai,a2) is minimum is a convex set. 

Then, there is an (a*, 02) G Ai x ^2 such that 



We start with the following lemma which bounds the distance between a quantum state and 
its normalized projection onto a subspace in which it has "large" support. It is a variant of the 
"gentle measurement lemma" due to Winter [16]. 

Lemma 4. Let p G D(^) be a quantum state in the Hilbert space %. Let 11 be an orthogonal 
projection onto a subspace ofTi such that Trllp = 6 < 1. Let p" = {I — Il)p(l — Il) be the projection 
of p onto the orthogonal subspace, and let p' = „ be this state normalized. Then f{p,p') >l — 5. 



Proof: Let /C be a Hilbert space with dim(/C) = dim.{'H). Let \v) G IC Ti he a purification 
of p [ig. Let \v") = (I (I - U))\v). Let \v') = \v")/ \\v"\\. Observe that Tr,c \v"){v"\ = p", so 



max min u{ai,a2) 




mm max n(oi, 02 

a2£A2 ai£Ai 



V 



Tr \v"){v' 



ji 



Tr p — Tr Hp 



l-<5 



and Tr/c = P' ■ Now, 



F(p,/>') > V{\vM,\v%v'\) 
= \{v\v')\' 



where the first inequaUty follows from the monotonicity of fidelity under completely positive trace 
preserving (CPTP) operations [12]. □ 



The next lemma is an important step in the proof, and along with the minimax theorem 
(Theorem [3]) yields the Quantum Substate Theorem. It mimics the proof of the Classical Substate 
Theorem with respect to a particular operator M ^ 0, which may be viewed as an unnormalized 
POVM element. Namely, we decompose M into its diagonal basis, and imagine measuring with 
respect to this basis. If the observational divergence of p with respect to a is small, then for most of 
the basis elements, the probability of the outcome for p is not too large relative to the probability 
for a. Projecting p onto the space spanned by these basis elements gives us a state p', close to p, 
for which TrMp' is correspondingly bounded, relative to TrMcj. 

Lemma 5. Suppose p,cr £ D(^) are quantum states in the Hilbert space T-L such that supp(p) C 
supp(cj). Let d = D{p\\a), e G (0,1), and M ^ be an operator on %. There exists a quantum 
state p' E D('W) such that f{p\p) > 1 — e and 

(l-e)-TrMp' < 2^/^-TrMcj. 

Proof: Consider M in its diagonal form M = X]i=i Pi\'^i){vi\^ where the {pi) are the eigenvalues 
of M corresponding to the orthonormal eigenvectors {\vi)). Let 



B 



{i : {vi\p\vi) > 2'^!^ ■ {vi\a\vi), l<i< dim(?^)} 



Let n = X^igs be the projector onto the space spanned by vectors specified by B. Then 

TrHp > 2^^/^ • TrHcT and hence, 

Tr Ho d 
d > (Trnp)log2-— f > (Trnp)--. 

Ir Ucr £ 

This implies that Trllp < e. Let p" = (I — II)/j(I — 11) and p' = -< From Lemma H] we 
have F(p, p') >1 — e. Finally, by the definition of 11, 

(l-£)-TrM/3' < TrM/ 

= ^Vi{vi\p\vi) 

< 2^/'^p,{vi\a\vi) 

< 2"^/^ • Tr Ma . 



□ 



We now prove the main result. Theorem [H For this, it suffices to produce a state close to p 
that when scaled suitably is a substate of a. The condition p' ^ na is equivalent to TrMp' < k 
for all Af ^ with Tr Ma < 1. We use this dual view of the substate condition to convert 
the minimization problem (PI) into a min-max optimization problem. We then use the minimax 
theorem. Theorem [3l to drastically simplify the search for a suitable state p' . As a consequence, 
it suffices to produce a state p' close to p such that Tr Mp' < k for an arbitrary but fixed M y_ 
with TrMiT < 1. 
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Proof of Theorem[Tt We first massage the program (PI) into a form to which Theorem [3] apphes. 
If a pair p\ k are feasible for (PI), then supp(p') C supp(cj). By taking Ti = supp(cr) if necessary, 
we may therefore assume that a y 0, i.e., a has full support. It is straightforward to check that for 
any given p' G D(^), 

min K = max Tr Mp' . 

Hence we may rewrite S^(p||(t) as the base-2 logarithm of 

min max Tr Mp' . 

p'yO : Tvp'=l, MtO-TrMa<l 
F(p',p)>l-£ 

Viewing p' and M as elements of the real vector space of Hermitian operators in L(?^), noting that 
fidelity is concave in each of its arguments |12j and that the trace function is bilinear, we may apply 
Theorem [3] to the resulting optimization problem. We get 

= max min TrMp' . 

M^O:TrM(T<l p'^0:Trp' = l, 
F(p',p)>l-£ 

By Lemma [5l for every M ^ with TrMcr < 1, there is a quantum state p', with f{p',p) > 1 — e, 
such that (1 — e) Tr Mp' < 2*^/^, where d = D{p\\a). The desired result now follows. □ 

Combining Theorem [T] and the Uhlmann theorem [12] immediately gives us the following state- 
ment. The Quantum Substate Theorem is often used in this form in its applications. 

Corollary 6. Let be Hilbert spaces with dim(/C) > dim(^), and let p,a & D(?^) be quantum 
states such that supp(/9) C supp(cr). Let d = D{p\\a), e G (0, 1), and \v) ^ K. (^T-L be a purification 
of p. Then there is a pure state \v') £ IC^T-L with f{\v){v\, \ v'){v'\) > 1 — e, and a pure state \w') £ 
/C (8) ^ such that \ w) £ C'^ JC (>S> Ti defined as 

\w) = \o)\v') + \i)\w') , 

with a = (1 — e)2^'^/^, is a purification of a. 

Proof: Let p' be a state given by Theorem [T] such that fidelity f{p', p) > 1 — £ and ap' ^ a. Then 
we can decompose a as 

a = ap + (1 — Oi)9 , 

where 9 £ D(^) is some quantum state. By the Uhlmann theorem [12] there is a purifica- 
tion \v') £ K^n oi p' such that V{\v){vl\v'){v'\) = f{p,p') > I - e. Let \w') £ )C (g> Ti he 
any purification of 9. Then we may verify that \w) as defined in the statement of the corollary is a 
purification of a. □ 

The dependence of the bound on the e-smooth relative min-entropy in Theorem [T] in terms of 
observational divergence is optimal up to a constant factor, as stated in Theorem [2j We start its 
proof with the following lemma. 

Lemma 7. Let 6, 6' £ [0, 1] and f3 £[0,1/4] such that 

(^V6J+^{l-6){l-6')y > 1-/35. 

Then 6' >{l- ^J^f 5. 
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Proof: Let u = [^5, Vl^Y and u' = [^5' , Vl^Y be vectors in M^. Let (/>, (p' G [0, 7r/2] be 

the angles u,u' make with (1,0)'^, respectively. By hypothesis, {u\u')'^ > 1 — Let 9 G [0,7r/2] 
be the angle between u, u', so that cos^ 6 >1 — (36. 

We wish to bound 6' = cos^ (/)' from below given that \cj)' — =9. Observe that cos((/> + 9) > 
^/6{1 - (35) - V(l - > 0, so that (() + 9 < 7r/2. Therefore, 5' takes its minimum value 
when (p' = (f> + 0. 

We may now bound 6' as follows. 

5' = cosset)' > cos2(0 + ^) 

> (^^S{1- (35) -y^il -5)(35y 

= (1 + /3)5 - 2(36^ - 2 ,5 (1 - (1 + /3)5 + (35^) ^''^ 

> (1 + /3)(5- 2/3^2 _ 2^^5(1 _ 5)1/2 

> {1 + ^)5-2(36^ -2^/^ 5(1 -6/2) 
= (l - 6 + i^/p - 2(3)6'' 

> (l- v^)'<5 , 

since /3 < 1/4. □ 

We are now ready to prove the optimality of Theorem [TJ 

Proof of Theorem [2 It suffices to prove that for any POVM element M £ PCH) with Tr{Mp) / 
0, 

T,{Mp) log^^ 

is bounded by 4/c + 3 from above. 

Fix such a POVM element M, let 6 = Tr(Mp), and e = (36 for some (3 G (0, 1) to be specified 
later. By hypothesis, there is a quantum state p' £ D(^) with F(p', p) > 1 — e and p' ^ Ka, where 

2fc/e 



1-e 

Let 5' = Tr(M/3'). By the monotonicity of fidelity under CPTP operations [12], we have 



65' + ^{l-6){l-5')) > f{p',p) > 1-e = l-(36 



By LemmaEl we have Tr(Mp') = 6' > {1 - y/^)^6 if (3 < 1/4. 
We set (3 = 1/4, so that Ti{Mp') > 6/4. Furthermore, 

as (5 < 1. So 

Tr(Mp) log = 5 log 7777^ < 4A; + 3 . 

^ '^^ ^Tr(Mcr) ^Tr(Mcj) ~ 

□ 



7 



3 A proof based on SDP duality 



In this section we present a second alternative proof of the Quantum Substate Theorem, Theorem[T] 
The proof is based on a formulation of smooth relative min-entropy as a semi-definite program. 

The optimization problem (PI) in Section [T] is seen to be an SDP once we express the fidelity 
constraint as a semi-definite inequality. This is based on a formulation due to Watrous [15] of the 
fidelity of two quantum states as an SDP. For completeness, we include a proof of its correctness. 

Lemma 8 (Watrous). Suppose p,p' € D(^) are quantum states in the Hilbert space %. The 
fidelity F(p, p') of the two states equals the square of the optimum of the following SDP over the 
variable X G L{'H). 



maximize: 



^ (TvX + TvX'' 



subject to: 



X 
P 
X G 



P 



(P2) 



Proof: By Theorem IX. 5. 9 in the text [1], the matrix inequality in the program (P2) holds iff there 
is an operator Y G L('H) such that ||y|| < 1 and X = ^/p'Yyfp. Since f{p',p) = ■\/p\\lj. and we 
may characterize trace norm as ||M||^.j, = max{|Tr(ZM)| : Z G L(?^), \\Z\\ < 1} for any M G L(^), 
the lemma follows. □ 



The problem (PI) may now be formulated as the following SDP with variables k G M, p' G 
L('H),X G L(?^) in the primal problem, and variables Zi, Z2 G L(?^) and 2:3, 2:4 G M in the dual, 
where Zi,Z2 are Hermitian. 



P3 Primal problem 



mmimize: 


K 


subject to: 




P 


:< Ka 


Trp' 


= 1 


(xt p) 


h 


TrX -FTrXt 


> 2V1 


p' G Un), 


p' hO 


K G M, 




X G un) 





P3 Dual problem 



maximize: Z4 + 2z^\/l — e + Tr(Z2/o) 
subject to: 

Tr(Zicj 
Z4I - Zi Z3I 
Z3^ Z2 

Zi G un) 

Z3 , Z4 G M 
Z2 G L(^) 



< 



1 


ZihO 

Z3>0 

Z2 Hermitian 



The equivalence of the problems (PI) and (P3) follows from Lemma [8] and paves the way for the 
second proof. 

Proof of Theorem [1} We may verify that strong duality holds since the P3 primal program is 
feasible, and the dual is strictly feasible |T5l[Tl]. Therefore, it suffices to bound the dual objective 
function for any set of dual feasible variables (Zi, Z2, 23, 24). 
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By Lemma O there is a quantum state p', with f{p',p) > 1 — e, such that (1 — e)Tr{Zip') < 
2^/^Tr(Zicj) < 2*^/% where d = D{p\\a). 

Since f{p',p) > 1 — e, by LemmaO there is an operator X G L('H) such that 



p' X 

xt p 



t , 



and TrX + TrXt > Therefore, 



In other words, 

Z4-Tr{Zip') + Z3{TTX + TiX^)+Tr{Z2p) < 0, 
which imphes that the dual objective function is bounded as 

Z4 + 2z3VT^ + Tr(Z2p) < Tr(Zip') < ^— - . 
This completes the proof. □ 



4 Conclusion 

We presented two alternative proofs of the Quantum Substate Theorem due to Jain, Radhakrishnan, 
and Sen [U [10]. In addition to giving bounds on the smooth relative min-entropy of two quantum 
states, this gives us a powerful operational interpretation of relative entropy and observational 
divergence. In the process, we resolve two questions left open by Jain et al. 

The crucial insight here is that the we may express smooth relative min-entropy as a convex 
or semi-definite program and appeal to duality theory. In this respect, we join a growing number 
of applications of convex and semi-definite programming to quantum information processing. This 
approach can be extended to the more general notion of smooth relative min-entropy studied by 
Renner to get similar bounds on this quantity. This view of the quantity may shed light on its 
numerous applications. 
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